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4(54) Method and apparatus for encoding a video signal 



(57) An apparatus for determining a predicted cur- 
rent frame based on a current frame and a previous 
frames comprises: a unit for selecting a number of pixels 
from the pixels contained in the previous frame to detect 
a first set of motion vectors; a unit for producing a second 
set of motion vectors for all of the pixels contained in the 
current frame by using said first set of motion vectors; a 
unit for assigning the value of each of the pixels in the 
previous frame as the value of said one of the pixels in 
the current frame by using the second set of motion vec- 
tors, to determine a preliminary predicted current frame; 
a unit for finding the difference between the current frame 
and the preliminary predicted currentframe to detect col- 



lective error regions: a unit for selecting one pixel among 
the pixels contained in each of the collective error 
regions; a unit for detecting a third set of motion vectors 
for the selected pixels from the collective error regions; 
a unit for producing a fourth set of motion vectors for all 
of the pixels contained in the current frame by using the 
said first set of motion vectors and the third set of motion 
vectors; and a unit for assigning the value of each of the 
pixels in the previous frame through one of the fourth set 
of motion vectors, as the value of said one of the pixels 
in the current frame. 
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ectors, as the value of said one of the pixels in the current frame, to thereby determine 
a preliminary predicted current frame; means for finding the difference between the current frame and the preliminary 
predicted current frame to determine collective error regions; means for selecting one pixel(supplementary quasi-f eature 
point) from the pixels contained in each of the collective error regions; means for determining a third set of motion vectors 
5 for the selected pixels from the collective error regions; means for producing a fourth set of motion vectors for all of the 
pixels contained in the current frame by using said first set of motion vectors and said third set of motion vectors; and 
means for assigning the value of each of the pixels in the previous frame, which corresponds to one of the pixels in the 
current frame through one of the fourth set of motion vectors, as the value of said one of the pixels in the current frame, 
to thereby determine the predicted current frame. 

10 

Brief Description of the Drawings 

The above and other objects and features of the present invention will become apparent from the following descrip- 
tion of preferred embodiments given in conjunction with the accompanying drawings, in which: 

75 

Fig. 1 is an image signal encoding apparatus having a current frame prediction block in accordance with the present 
invention; 

Fig. 2 shows a detailed block diagram of the current frame prediction block of Fig. 1 ; 
Fig. 3 exhibits an exemplary block diagram of the collective error region detection block of Fig. 2; 
20 Fig. 4 offers a detailed block diagram of the supplementary quasi-f eature point and its motion vector detection block 
of Fig. 2; 

Fig. 5 describes an exemplary frame for defining feature points; 

Figs. 6A and 6B illustrate two types of grids used to select feature points; 

Figs. 7A and 7B provide the technique of selecting feature points through the use of grids and edges; 
25 Fig. 8 depicts a method of detecting a motion vector for a non-quasi-feature point; 

Figs. 9A to 9E demonstrate the technique of detecting a collective error region; and 

Figs. 10A and 10B explain the technique of detecting a supplementary quasi-feature point and its motion vector. 
Detailed Description of the Preferred Embodiments 

30 

Fig. 1 describes a preferred embodiment of an image signal encoding apparatus having a current frame prediction 
block of the present invention. As shown in Fig. 1 . a current frame signal is stored in a first frame memory 1 00 which is 
connected to a subtracter 102 through a line L9 and to a current frame prediction block 150 through a line L10. 

In the current frame prediction block 1 50. a current frame signal on the line L1 0 retrieved from the first frame memory 
35 1 00 and a reconstructed previous frame signal on a line L1 2 from a second frame memory 1 24 are processed to predict 
the current frame on a pixel-by-pixel basis to generate a predicted current frame signal onto a line L30 and a set of 
motion vectors for feature points onto a line L20. Details of the current frame prediction block 1 50 will be described with 
reference to Fig. 2. 

The predicted current frame signal on the line L30 is subtracted from a current frame signal on the line L9 at the 
40 subtracter 1 02, and the resultant data, i.e., an error signal denoting the differential pixel value, is dispatched to an image 
signal encoder 105, wherein the error signal is encoded into a set of quantized transform coefficients, e.g., by using a 
DOT and any of the known quantization methods. Thereafter, the quantized transform coefficients are transmitted to an 
entropy coder 107 and an image signal decoder 113. At the entropy coder 107, the quantized transform coefficients 
from the image signal encoder 105 and the motion vectors transmitted through the line L20 from the current frame 
45 prediction block 150 are coded together by using, e.g., a variable length coding technique; and transmitted to a trans- 
mitter(not shown) for the transmission thereof. 

On the other hand, the image signal decoder 113 converts the quantized transform coefficients from the image 
signal decoder 105 back to a reconstructed error signal by employing an inverse quantization and an inverse discrete 
cosine transform. 

so The reconstructed error signal from the image signal decoder 1 13 and the predicted current frame signal on the 
line L30 from the current frame prediction block 150 are combined at an adder 1 1 5 to thereby provide a reconstructed 
current frame signal to be stored as the previous frame in the second frame memory 124. 

Referring to Fig. 2, there are illustrated details of the current frame prediction block 150 shown in Fig. 1. As shown 
in Fig. 2. a previous frame signal on the line L12 from the second frame memory 124 is inputted to a feature point 

55 selection block 210. a feature point motion vector detection block 212, a first motion compensation block 216, a supple- 
mentary quasi-feature point and its motion vector detection block 220 and a second motion compensation block 224. 

At the feature point selection block 210, a number of feature points are selected from the pixels contained in the 
previous frame. Each of the feature points is defined as a position of a pixel, representing the motion of an object in the 
frame. Referring to Fig. 5, there is shown an exemplary frame of 10x7 pixels. If a moving object exists around the center 
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of the frame and the motion of the^ng object is successfully represented by a sSfpixels "A" to T these oixels 
are selected as the feature points of the frame. ' tnese pixels 

Inapreferred embodiment of the present invention, the feature points are determined by a grid technique emplovino 
vanous types of gnds. e.g.. rectangular grids or hexagonal grids shown in Figs. 6A and 6B respSve lv As sTown iS 
Figs. 6A and 6B. feature points are located at the nodes of the grids respectively. As shown in 

In another preferred embodiment of the invention, an edge detection technique is employed together with the above 

of Z b m t?n r ^ iqUe ^ in Fi9S - ?A 3nd 7B ,n thiS ***** ini ™«*™ P^SX^tE 
of the moving object are selected as the feature points. 9 

Referring back to Fig. 2. the selected feature points from the feature point selection block 210 are inputted to a 
^^T:^Z det ^ 0n b ' 0Ck 212> 8 firSt motion vector detection btock 214 and a second rTo^edor 

. t !"Ji e I ea !" re 1 p ° int motion vector detection bl «* 212. a first set of motion vectors for the selected feature Mints is 
detected. Each of the motion vectors of the first set represents a spatial displacement bJ^TSSS^SStl 
previous frame and a most similar pixel thereto in the current frame ^ 
m •.Hi!'! ar L man ! P rocessin 9 a'sorithms which may be used in detecting the motion vectors on a pixel-by-pixel basis 
^ZlTZ emb ° d,mente of < he inven «° n . ^re is used a block matching a.gorithm: when a iJSSt^SteSSS 
S e f 50 " 1 selec, . ,on block 210 « a point block having the feature point at the center S eg sS 

pix^s ofthepreviousframe. ,s retrieved via the Im 

T°l ^ ,eatUfe P*" * determined after a 8imila *y «-«**« Seen Sure 
point block and each of a plurality of equal-sized candidate blocks included in a generally larger sS2 T 
10x10 pixels, of the current frame retrieved from the first frame memory I00(shown in Fig 1 

mnt^!^!! 9 ?'?!" 16 Til VeC,0rS f ° r a " ° f the feature P 0 '"* 5 - 1,16 ,irst set of vectors is provided to the first 
^ i of?' 0 " ^ 21 4 and 6nlropy "** 1 07 < shown in R 9- 1 ) vh the line L20. In VmiumS^Z 

through the use of the f ,rst set of motion vectors and tee feature point information from the feature pST^ZZS 

™JHi?£ t0 det T ine the , second set * motion vectors, a set of motion vectors for "quasi-feature points" which 
present those pixel points of the current frame shifted from the feature points of the prevLs frame bySt se 5 
ration vectors, are determined. The magnitude of a motion vector for a quasi-feature point is idTntiS ?i£n52 
vector for rts corresponding Mature rooim; but *edirec*on between the two motion vedors is ^ 
the motion vectors for all of the quasi-feature points, the motion vectors for the remaining SS^^Z 
feature points in the current frame, are determined as follows. non-quas.- 

vJ^ST^^JnT* 3 " qi ? Si - fea ! ure P° ints are irre 9 ularIv distributed in the entire current frame. A motion 
vector for a star marked non-quas.-feature point is determined by averaging the quasi-feature points which are daced 
wrth,n a arde boundary having a radius of "dr+da". wherein "da" is the distance to a nJ^^^SrJS! 

TJZZSST ft' "S " df " iS 8 P redetermined «P«*B «*■ *>' Mud* oiJfeZ. pX to be uS 

nthe moton v^or calculation. For example, rf the nearest featorerxN 
the boundary of "d a+ dr". the motion vector (MV x .MV y , for the star marked pixel is calculated T 
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55 



a^dTJlvVv? tdLv 6 tTr S °l quasi - feature X ar * Y the star marked pixel position, respectively; 
and (MV x .MV y ) x and (MV x .MV y ) Y are the respective motion vectors for the quasi-feature points 

Referring back to Fig. 2. the second set of motion vectors for the quasi-feature points and the non-ouasi feature 
ZEZTt? tC V he i irSt m0fi0n c °^ ensation Wock 216 via a line L16. In the meantime, the par S * e 

The fret motion compensation block 216 assigns the value of each of the pixels in the previous frame stored in the 
second frame memory 124(shown in Fig. 1). which corresponds to one of the pixels in the L^SS^I^S^, 
the second set of moton vectors, as the value of said one of the pixels in *e current tmn+£££?^* 
prelimi^edicted current frame. The output of the motion compensation block 216 is provided ho aMWetnor 
reg.on detection block 218 and the supplementary quasi-feature point and its moton vector detection bio* So 

Fig 3 illustrates details of the collective error region detection block 150 shown in Fig. 2. As shown in Fia 3 a 
current frame is provided through the line L10 from the first frame memory 100 and the pre\mZy^ZaedVrenX 
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' from the first motion compensation block 2 1 6 are inputted to a subtracter 302 which 
is connected to an absolutizing block 304. If the current frame signal is as shown in Fig. 9A and the preliminary predicted 
current frame is as shown in Fig. 9B, an output from the subtracter 302 and the absolutizing block 304 may be represented 
as the one shown in Fig. 9C. 

5 As shown in Fig. 9C, a number of error potions may be found around, e.g.. the eyes and mouth and edge of the 
moving object. The absolute error signal from the absolutizing block 304 is provided to a filter 306, wherein the absolute 
error signal is filtered so that tiny error regions are eliminated as shown in 9D. Thereafter, the filtered error signal is 
supplied to the collective error region detection block 308 wherein the collective error region is partitioned by using 
rectangular windows as shown in Fig. 9E to provide a collective error region signal onto a tine L18. 

to Referring back to Fig. 2, the collective error region signal on the line L18 is provided to the supplementary quasi- 
feature point and its motion vector detection block 220, wherein one pixel is selected among the pixels in each of the 
collective error regions and a motion vector for the selected pixel is determined as the quasi-feature point and its motion 
vector. Fig. 4 depicts details of the supplementary quasi-feature point and its motion vector detection block 220 shown 
in Fig. 2. 

75 As shown in Fig. 4, a collective error region signal is provided to a motion vector selection block 400 and a motion 
vector detection block 402 to notify a collective error region thereto. In the motion vector selection block 400, in response 
to the collective error region signal, a first group of motion vectors for the pixels in the collective error region is selected 
from the second set of motion vectors provided from the first motion vector detection block 214(shown in Fig. 2). And 
the first group of motion vectors is provided to a subtracter 406. 

20 In the meantime, in the motion vector detection block 402, a second group of motion vectors for the pixels in the 
collective error region is determined between the current frame and its previous frame stored in the frame memory 404. 
And the second group of motion vectors is also provided to the subtracter 406. 

Thereafter, in the subtracter 406, the difference between the two groups of motion vectors is calculated. And the 
magnitude of the difference of each of the pixels is calculated at an absolutizing block 408. And then, the output of the 

25 absolutizing block 408 is segmented according to the magnitude of the difference between the two groups of motion 
vectors. If the magnitude of the difference is as shown in Fig. 1 0A, the collective error region is divided into two subregions 
at the segmentation block 410 as shown in Fig. 10B. In this situation depicted by Fig. 10B, a star marked pixel becomes 
a quasi-feature point of this collective error region, and its motion vector is selected as follows. First, a majority motion 
vector detection block 418 detects a subregion motion vector for each of the two subregions by selecting a majority 

30 motion vector for each of the subregions. to send a first subregion motion vector to a first motion vector detection and 
motion compensation block 420 and a switch SW1 through a line L42; and to send a second subregion motion vector 
to a second motion vector detection and motion compensation block 420 and the switch SW1 through a line L44. In the 
meantime, a selected center point of the collective error region from the center point selection block 412 is combined 
with the quasi-feature points provided through the line L15 from the first motion vector detection block 214, and the 

35 resultant data is provided to the first and the second motion vector detection and motion compensation blocks 420 and 
422. 

The first motion vector detection and motion compensation block 420 detects motion vectors for all of the pixels in 
the collective error region by averaging at least one of the combined motion vectors between the set of motion vectors 
for the quasi-feature points and the first subregion motion vector; and retrieves the value of each of the pixels contained 
40 in the collective error region from the second frame memory 124, to thereby determine a first predicted region which is 
supplied to a first mean square error detection block 424. 

The second motion vector detection and motion compensation block 420 detects motion vectors for all of the pixels 
in the collective error region by averaging at least one of the combined motion vectors between the set of motion vectors 
for the quasi-feature points and the second subregion motion vector; and retrieves the value of each of the pixels in the 
45 collective error region from the second frame memory 124, to thereby determine a second predicted region which is 
supplied to a second mean square error detection block 426. 

In the first mean square error detection block 424, the difference between the current frame and the first predicted 
region is determined, and the result is provided to a comparison and selection block 428. In this manner, in the second 
mean square error detection blocks 426. the difference between the current frame and the second predicted region is 
so determined, and the result is supplied to the comparison and selection block 428. 

In the comparison and selection block 428, it is determined which of the outputs from the two mean square error 
detection blocks 424 and 426 is smaller than the other, and a switch control signal is provided to the switch SW1 . wherein 
one of the two inputs on the lines L42 and L44 is selected and provided to a multiplexer 416. In the multiplexer 416, a 
center point from the center point selection block 41 2 and its motion vector provided from the switch SW1 are combined; 
55 and the result as a supplementary quasi-feature point and its motion vector are provided to the entropy coder 107. 

Referring back to Fig. 2. in the second motion vector detection block 2 1 4. a third set of motion vectors fa all of the 
pixels contained in the current frame is determined through the use of the quasi-feature points and the supplementary 
quasi-feature points. And the third set of motion vectors is provided to the second motion compensation block 224. The 
second motion compensation block 224 assigns the value of each of the pixels in the previous frame stored in the second 
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^0.0*214. thefi^^^^ 

quasi-feature point and its motion ^S?Si!^ <lataC !S ,, f 10 * 218 " "W—tHrtwy 

supplementary quasi-featurepointsar^theirSon^ ,he "** ^ *» 

fore, the motion prediction block will have a iBB^^S^^f *! enCOder are provided thereto - ™*e- 
block and a second motion compensation 

encoder. ^ D 0CK Wh0se ,unct,ons are tne same as those explained with respect to the 

vectors for all of the pixels to be conteS ESESS cunLVZ ^ d *"*° n *** determines *• ™«°n 
supplementary quasi-feature points andlheS 

fig. 2. The second motion compensation block3id« Z ZJ^i 6 enCOder explained with refer ence to 
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tors; and 

means for selecting one motion vector from the subregion motion vectors, to provide each motion vector in 
the third set of motion vectors. 

5 5. The apparatus in accordance with claim 4, wherein said fourth set of motion vectors producing means includes: 
means for assigning the first set of motion vectors and the third set of motion vectors as one part of the fourth 
set of motion vectors; and for averaging at least one motion vector contained in said one part of the fourth set of 
motion vectors to thereby determine the remaining part of the fourth set of motion vectors. 

10 6. A method, for use in a motion-compensated video signal encoder, for determining a predicted current frame based 
on a current frame and a previous frame of a digital video signal, comprising the steps of: 

(a) selecting a number of pixels from the pixels contained in the previous frame; 

(b) detecting a first set of motion vectors between the current and the previous frames, each of the first set of 
motion vectors representing a motion for each of the selected pixels; 

(c) producing a second set of motion vectors for all of the pixels contained in the current frame by using said 
first set of motion vectors; 

(d) assigning the value of each of the pixels in the previous frame, which corresponds to one of the pixels in the 
current frame through one of the second set of motion vectors, as the value of said one of the pixels in the 
current frame, to determine a preliminary predicted current frame; 

(e) finding the difference between the current frame and the preliminary predicted current frame to detect col- 
lective error regions; 

(Q selecting one pixel from the pixels contained in each of the collective error regions; 

(g) detecting a third set of motion vectors for the selected pixels from the collective error regions; 

(h) producing a fourth set of motion vectors for all of the pixels contained in the current frame by using the first 
set of motion vectors and the third set of motion vectors; and 

(i) assigning the value of each of the pixels in the previous frame, which corresponds to one of the pixels in the 
current frame through one of the fourth set of motion vectors, as the value of said one of the pixels in the current 
frame, to thereby determine the predicted current frame. 

The method in accordance with claim 6, wherein said step(c) includes the steps of: 

(d) assigning the first set of motion vectors as one part of the second set of motion vectors for those pixels in 
the current frame corresponding to the selected pixels in the previous frame; and 
35 (c2) averaging at least one motion vector contained in said one part of the second set of motion vectors to 

thereby determine the remaining part of the second set of motion vectors. 

8. The method in accordance with claim 6, wherein said step(e) includes the steps of: 

40 (e1) subtracting the preliminary current frame from the current frame to produce an error region signal; 

(e2) absolutizing the error region signal; 
(e3) filtering the absolute error region signal; and 

(e4) windowing the filtered absolute error region signal to produce the collective error region signal. 

45 9. The method in accordance with claim 6, wherein said step(g) includes the steps of: 

(g1) dividing each of the collective error regions into at least two subregions according to the magnitude of the 
error value of each of the pixels therein; 

(g2) detecting a subregion motion vector for each of the subregions to threrby produce the subregion motion 
so vectors; and 

(g3) for selecting one motion vector from the subregion motion vectors, to provide a collective error region 
motion vector. 

10. The method in accordance with claim 9, wherein said step(h) includes the steps of: 

55 

(hi) assigning the first set of motion vectors and the collective error region motion vectors as one part of the 
fourth set of motion vectors; and 

(h2) averaging at least one motion vector contained in said one part of the fourth set of motion vectors to thereby 
determine the remaining part of the fourth set of motion vectors. 
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